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cluster of features on . the photographic mat 34 7 ; this 
processing replacing the processing in the first 
embodiment performed at step S32 and step ^S34 in 
Figure 7 . t 

Referring to Figure 41, at step. S960, processing 
apparatus 2 processes the image data to generate a. binary 
image corresponding to the input image, in which each 
pixel in the input image, which has a colour corresponding 
to .the colour of one of the coloured regions defining 
clusters 3250-3320 on photographic mat 34 (that is,, red, 
green, blue or cyan in this embodiment) is set to 1, and 
pixels haying other colours are set to 0- This 
.processing is performed in the same way as step S900 
(Figure 38) in the eighth f embodiment , 4 and accordingly 
will not be described again here . 

At step S962, processing apparatus 2 processes the binary 
image data generated at step S960 to find groups 
comprising pixels having the value 1 which are connected 
in the binary image, so as to identify spatially isolated 
groups of pixels having the value 1. This processing is 
performed in a conventional manner, for example as 
described in "Digital Image Processing and Computer 
Vision" by R.J. Schalkoff, John Wiley & Sons, ISBN 
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047150536-6, page 276/ and the result of this processing 
is the detection of groups of pixels representing any of 
the solid colour areas de fining clusters 3250-3320 which 
are visible in the input image, together with the 
detection of groups of pixels representing red, green, 
blue or cyan features on the object 400 which are visible 
in the input image. 

> At step S964, processing apparatus 2 discards each group 
found at step S962 which contains less than a threshold 
number- of pixels ( set: to 25 in this embodiment) . This 
processing corresponds to step S54 in Figure 8 . 

At step S966, processing apparatus 2 considers the next 
group of pixels remaining after step S964 has been 
performed, and at step S968 considers the portion of the 
binary image (generated at step S960 ) enclosed by the 
boundary pixels of the group. 

At step S970> processing apparatus 2 processes the pixels 
in the portion of the binary image selected at step S968 
to find groups comprising pixels having the value 0 which 
are connected in the binary image. In this embodiment, 
the processing at step S970 is performed in a 
conventional manner, for example as described in "Digital 
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Image Processing and Computer Vision" by R. J. * Schalkof f , 
John Wiley & Sons, ISBN 047150536-6, page 276. The 
result, of the processing at step S970 is the detection of , 
groups of pixels representing holes in the current area 
currently being considered (selected at step S966). 
Consequently, the processing at - step S970 will detect 
circular hole features representing features on 
photographic mat 34. \. , _ 

At step S972, processing apparatus 2 discards' each group 
found at step S970 which contains less than a threshold 
number of pixels (set to 25 in this embodiment) so as to 
discard groups of pixels which are too small to represent 
a feature on the photographic mat 34. 

At step S974,- processing apparatus 2 processes each group 
of pixels remaining after step S972 has been performed to 
determine and store the number of pixels in the group, 
and the unique point position in the image defined by the 
group (this being- the centre of the group of pixels in 
this embodiment, calculated by determining the centre of 
gravity of the group of pixels in a conventional manner). 

At step S976, processing apparatus 2 determines whether 
there are three, and only three features ( that is, groups 
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of pixels, having .the value , 0) < in the candidate cluster. 

If it is determined at step S976 that there are not three 
features in the candidate clustery then the processing 
proceeds to step S980, at which the cluster is discarded. 

: On the other hand, if it is determined at step S976 that 
there are three, and only three features, in the cluster/ 
then a second test is performed by processing apparatus 2 
at step S978 to determine whether there are two , and only 
two, sizes, of feature in the* cluster. This test is 
performed using :the information - defining the number of 
pixels in each group stored at step S974, and; by 
determining that two features are of the same size if the 
number of pixels therein does not differ by more than 20% 
times the number of pixels in the largest feature... 

If it is determined at step S978 that the features in the 
cluster* have more or less than two different sizes , then 
at step S980, the cluster is discarded. 

On the other hand, if it is determined at step S978 that 
there are two sizes of feature in the cluster, step S980 
is omitted, so that at step S982 the cluster is retained 
and the colour of the input image portion in which the 
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features lie is stored (this colour being determined* from 
the colour values of the original input image 
corresponding to' the pixels , considered at step S966 
above) . . * 

At step S9 84, processing apparatus 2 determines whether 
there is another group of pixels representing a coloured 
area in the input image. Steps S966. to S984 are repeated 
until each group of pixels representing a coloured area 
has been processed in the manner described '.above.. . 

In .summary, by performing the. processing described above 
■'< with reference to Figure 41, , processing apparatus 2 
.. detects closed regions in the input image' having a 
predetermined colour, detects holes in each such region, 
and considers the holes for each respective region as a 
candidate cluster of features* ' Accordingly, the 
detection of candidate clusters can be considered to be 
k based on the positions of features (that is, lying within 
a closed region of predetermined colour) or the 
connectedness of features (that is connected by a region 
of predetermined colour) . Each candidate cluster is 
then processed to determine whether it contains three, 
and only three, features having two, and only two, 
different sizes. If these conditions are satisfied, then 
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the cluster is ; considered to represent a cluster of 
features on the photographic mat 34. 

Figure 42 shows the processing operations performed by- 
feature identifier 70 in the ninth embodiment at step S36 
in Figure 7 to label each feature identified as being 
part of a cluster (that is, to assign a unique one-to-one 
correspondence between each feature in the input image 
which is part of a cluster and a feature on the 
photographic mat 34 ). - . - : 

Referring , to Figure 42 , at step S1000, feature 
identifier- 70 considers the next cluster of features 
(this being the first cluster the first time step S1000 
is performed), and at step S1002, reads the colour of the 
image portion in which the features lie (previously 
' stored at step S982 in Figure 41). • \ 

At- step S1004* feature - identifier 70 determines the 
straight line distance in the image between the centres 
of each pair of features in the cluster. 

At step S1006, feature identifier 70 reads the size (that 
is the number of pixels stored at step S974 in Figure 41) 
of the end features in the cluster, the end features 
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being determined as the features which have the greatest 
distance therebetween (for example features 3342 and 3344 
for cluster 3250 in Figure 40). 

At step S1008, feature identifier 70 reads the size of. 
the centre feature in the cluster (that is, /the feature, 
which is not an end feature) previously stored at step 
S974 in Figure 41. 

At step S1010, feature identifier 70 labels the cluster 
in dependence upon the colour read at step S1002 (which 
restricts the cluster to be one of the two .clusters on 
the photographic mat 34 which has features . lying in an 
area: of that colour) and the sizes read at steps. S1006. 
and S1008 (which uniquely identify the cluster from- the 
two possibilities in dependence upon whether there 1 are 
two large features and one small feature or two small 
features and one large feature). In addition, having 
labelled the cluster, feature identifier 70 labels each 
of the: features therein. More particularly , each end 
feature is assigned a unique label in dependence upon the 
relative sizes of these features (since, in each cluster, 
one end feature has a large area and one end feature has 
a small area) and the centre feature is labelled 
irrespective of whether it has a large area or a small 
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. area since there is only one centre feature in* this 
. embodiment s - •.: ; . , \ « 

At* step is 10 12; feature identifier 70 stores, for each 
• feature in the cluster', the coordinates of the features 
unique point ; position in both the image and the 
photographic mat 34. , 

At step SI 014, feature identifier 70 determines whether 
there ; is another cluster of features . Steps S1000 to 
S1014 are repeated until each cluster has been processed 
;< in* the 'manner described. abo>ve. / ; . : 

In summary, by performing the processing described above 
.with reference to Figure 42, feature identifier 70 labels 
each feature: in dependence upon the colour of the area in 
which the features lie and the relative sizes; of the 
features. « 

Tenth Embodiment — 

A tenth * embodiment of the invention will now be 
described. 

In each of the first to ninth embodiments, processing is 
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performed 'to detect the features in an image which 
represent features on the photographic mat 34 , and then 
to identify the correct one-to-one correspondence between 
each detected feature in the image and a feature on the 
photographic mat 34. The correct one-to-one 

correspondences are then used to determine the position 
and orientation of the camera 410 when the image was 
recorded. However, once features in the image have been 
detected which represent features on the photographic 
mat 34,. it is not necessary to: identify the correct one- 
to-one correspondence between each feature in the image 
and a feature on the photographic mat 34. Instead, in 
the tenth embodiment, the position and orientation of 
camera 410 is calculated without first determining the 
correct one-to-one correspondences between the features 
in the input image and the features on the photographic 
mat- 34 . 

The components of the tenth embodiment and the processing 
operations performed by the components are the same as 
those in the first embodiment, with the exception that 
the pattern on the photographic mat 34 is different, the 
processing performed by feature detector 50 at step S32 
in Figure 7 is different, and the separate processing 
operations performed by feature identifier 70 and camera 
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: . calculator 80 at . steps S36 . and S38 in Figure 7 are 
/ different and become combined, These differences .will 
now be described . 

: Figure 43 shows the pattern of features on a photographic 
mat 34 printed or displayed in the tenth embodiment. 

Referring to Figure A3 , the pattern on photographic 
mat 3 4 comprises a plurality of clusters 3400-3470,, of 
which there are. eight in, this embodiment .: . ,-Each cluster 

-contains four features which, in this embodiment, - are 

■ v 
: *. identical black circles . . , : : ....... 

As in the first embodiment, in the tenth embodiment, the 
feature circles are spatially grouped on the photographic 
mat 34 so that the distance between the centre of any two 
features in a given cluster is less than the distance 
between a feature in the given cluster and a feature in 
. a different cluster. 

In addition, as in the first embodiment, each cluster of 
circles in the tenth embodiment is orientated so that an 
imaginary line (that is, a line not, actually present on 
photographic mat 34) through the centres of one pair of 
circles in the cluster (shown as line 3480 for cluster 
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.3400 and as line 3482 for cluster 3430 in Figure 43) 
passes through a predetermined reference point 3484 on 
the photographic mat. 

In* the first embodiment,, the clusters 200-222 are 
arranged on the photographic mat so that the distance of 
each cluster from the predetermined reference point 352 
is 1 the same. However, in the tenth embodiment, this is 
not the case. More particularly, clusters 3400, 3420, 
3440 and 3460 are arranged so that the distance of each 
cluster from the reference point 3484 is the same, but 
clusters 3450 and 3470 are arranged so that the distance 
from the reference point 3484 to each of these clusters 
is the same but larger than the distance from' the 
reference point 3484 to one of the clusters 3400, 3420, 
3440 or 3460. Similarly, clusters 3410 and 3430 are 
positioned so that the distance from the reference point 
3484 to these clusters is the same but less than the 
distance from the reference point 3484 to any one of the 
clusters 3400, 3420, 3440 or 3460. This positioning of 
clusters gives the pattern on the photographic mat 34 the 
property that it is rotationally asymmetric. 

Clusters 3400-3470 are arranged around a blank area 3490 
on which the object 400 is to be placed,. the blank area 
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3490 being defined by a circle 3492 having the diameter 
stored at step S4 in Figure. 2. 

The processing performed by feature detector 50 at step 
5. S32 in Figure 7 to detect features in an input image is 

different from that performed in the first embodiment in 
• that the thresholds used at steps S50 (Figure 8) to 
- . generate a / binary image are dif ferent, , and -step S60 
. (Figure 8) is not performed since all features on the 
10 v photographic mat 34 in the tenth embodiment are black. 

More particularly, in the tenth embodiment, the. threshold 
• values used at step S60 to generate a binary ,imag[e/ are 
the same as those set out in equation (6) ; for the sixth 
embodiment* ~ 

v.;: is •• : - : ■; , • ■< , ■ . . ... . . ... - . . ..... . ' 

Figure 44 shows the processing operations performed in 
the tenth embodiment by feature identifier 70 and camera 
calculator 8 0 to process features determined by feature 
clusterer 60 to be part of a cluster in the input image 
20 which represents a cluster on the photographic mat 34, so 

as to determine the position . and orientation of the 
camera 410 when the input image was recorded. 



25 



Referring to Figure 44, at step SHOO, processing 
apparatus 2 determines the position in the image of the 
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predetermined reference point 34 84 on the photographic 
mat 34. This processing corresponds to the processing 
performed at step S140 (Figure 12) in the first 
embodiment, and accordingly will not be described again 
here . 

At step S1102, processing apparatus 2 assigns a relative 
label to the features in each cluster in dependence upon 
the rotational order of the features relative to the 
reference point determined, at step ^SllOO. -This; 
processing is the same as the processing performed at 
- step S142 (Figure 12) in the first embodiment , and 
1 accordingly will not be described again here. 

At step SI 104, processing apparatus 2 determines the 
rotational order of" the clusters visible in the input 
image relative to the reference point 3484 determined at 
step SHOO. More particularly, processing apparatus 2 
determines the order of the visible clusters iri . a 
clockwise direction from a reference cluster selected 
from the visible clusters at random. This processing is 
performed in a conventional manner, for example by 
selecting the cluster as the next cluster in a clockwise 
direction as the cluster which, when its centre is 
connected to the centre of the previous cluster, results 



WO 01/39124 ; 



PCT/GB00/04469 



174 

in the other clusters » lying to the right of the 
connecting line. 4 

J ' ■ . 

. As a result of the processing up to step S1104, 

processing apparatus 2 has detected the clusters of 

: features in the input image which represent features on 

the photographic mat 34 and has determined the rotational 

order of the clusters. Thus, assuming that the object 

400 obscures one or more of the clusters 3400-3470 so 

that these clusters are < not visible : in the image / and 

that the obscured clusters are adjacent to each other, 

processing apparatus -2^ has detected the subset: of 

clusters which are visible in the input image, ^nd^ has 

determined the relative order of the clusters in the 

subset. However, at this stage, processing apparatus 2 

has not determined which subset of the clusters on 

photographic mat 34 has been detected in the input image. 

In subsequent processing, ■ processing, apparatus 2 
considers each possible subset of* clusters on the 
photographic mat 34 that the detected subset could 
represent, calculates and tests the position arid 
orientation of camera 410 for each possibility, and 
selects the most accurate position and orientation - 
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More particularly, at step S1106, processing apparatus 2 
selects the next cluster from the clusters 34 00-3 4 70 on 
the photographic mat 34 to be labelled as the reference 
cluster used to determine the relative order at step 
5 S1104 (this being the first cluster from the photographic 

mat the first time step S1106 is performed). 

At step S1108, processing apparatus 2 labels each feature 
in the input image in dependence- upon the cluster 

10 selected to be labelled as the reference cluster at step 

S1106. That is, processing apparatus 2 assigns a unique 
one-to-one correspondence between each feature in a 
cluster in the input image, and a feature on: the 
photographic mat 34 based on the reference cluster. More 

15 particularly , if; for example, cluster 3400 is selected 

at-step S1106, then, at step S1108 the reference cluster 
in the input image is labelled as cluster 3400, and the 
other clusters in the input image are labelled using the 
cyclical order determined at step«S1104 as clusters 3410, , 

20 3420 etc. On the other, hand, if, for example, cluster 

3450 from photographic mat 34 is selected at step S1106, 
then, at step S1108 the reference cluster in the input 
image is labelled as cluster 3450 and the remaining 
clusters in the input image are labelled in cyclical 

25 order as clusters 3460, 3470, 3400 etc. In addition, 
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having allocated a label to each cluster in the input 
image, processing apparatus 2 allocates a label to each 
feature therein in ^dependence upon their relative 
positions within the cluster determined at step S11Q2. 

As a result of performing the processing at steps S1106 
and S1108, processing apparatus 2 has allocated a one-to- 
one correspondence between, each feature in the input 
image and a feature on the photographic mat 34. However, 
the allocated one-to-one correspondences will not be the 
correct correspondences unless the cluster from the 
photographic mat 34 selected at step .SI 10-6 actually 
corresponds to the reference cluster in the input image. 

At step Sll 10, processing apparatus 2 resets the value of 
a counter to zero. 

At steps S1112 to S1126, processing apparatus 2 uses the 
. one-to-one correspondences allocated at step S1108 to 
calculate and test the position and orientation of the 
camera 410. The processing performed insteps S1112 to 
S1126 is the same as the processing performed at steps 
S252 to S266 described above in. the first embodiment , and 
accordingly will, not be described again here. 
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At step SI 128, processing apparatus 2 determines whether 
there is another cluster on the photographic mat 34 which 
has not yet been selected to be labelled as the reference 
cluster in the input image. Steps S1106 to S1128 are 
repeated until every cluster on the photographic mat 34 
has been selected at step S1106 to be the reference 
cluster. In this way, the subset of clusters detected in 
the input image is compared against each subset- of 
features on the photographic mat 34 to which it could 
correspond- * * * 

: If the one-to-one correspondences allocated at step S1108 
are not the correct correspondences, then the test of -the 
calculated camera transformations performed at step S1118 
will indicate a relatively large error because the 
pattern of features on photographic mat 34 s is 
rotationally asymmetric in this embodiment. On the other 
hand, when the cluster from the photographic mat 34 
selected at step S1106 actually corresponds to the 
reference cluster in the input image, the test performed 
at step S1108 will indicate a smaller error (higher 
accuracy) for the camera transformations than when the 
test is performed at step SI 118. Accordingly, when steps 
S1106 to S1128 have been performed for every one of the 
clusters on the photographic mat 34 (that is, eight times 
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in. ./this, embodiment) ' the. stored camera transformations 
will be the camera transformations calculated using the 
correct one-to-one correspondences (since these will have 
the highest accuracy and will therefore be retained in 
memory at steps S1120 and S1122). 

In - summary, therefore , in the tenth embodiment, 
processing apparatus 2 does not perform processing to 
calculate the correct one-to-one correspondences between 
features in the input image and features on : the 
photographic, mat 34. prior to calculating the position and 
orientation of ^ camera, 410 . - ; -Instead, processing 
; apparatus 2 calculates the position and orientation- of 
camera 410 using different- sets of one-to-one 
correspondences, and selects the most accurate position 
and orientation which results. 

Eleventh Embodiment 

An eleventh embodiment of the invention will now be 
described. 



In the first to tenth embodiments, processing is 
performed to detect candidate clusters of features in an 
image on the basis of the relationship between the 



WO 01/39124 



i 



PCT/GB00/04469 



179 

spatial positions of the features on the photographic mat 
34 or the connectedness of the features on the 
photographic mat 34. Each candidate cluster is then 
tested *. to determine whether it represents a cluster on 
the photographic mat 34 in dependence upon at least one 
further relationship between the features based on the 
size, colour and/or shape of the features. In the 
eleventh embodiment, however, this processing; is 
reversed, and candidate clusters are detected using a 
relationship between the colours of features in a cluster 
on the photographic mat 34, and subsequently each 
candidate cluster * is tested in dependence upon a 
relationship between the spatial positions : of the 
features on the photographic mat 34. 

The components of the eleventh embodiment and - the 
processing operations performed by the components are the 
same as those in the first embodiment, with the exception 
that the pattern on the photographic mat 34 is different, 
the processing performed by feature detector 50 at step 
S32 in Figure 7 is different, the processing performed by 
feature clusterer 60 at step S34 in Figure 7 is 
different, and the processing performed by feature 
identifier 70 at step S36 in Figure 7 is different. 
These differences will now be described. 
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Figure 45 shows the pattern of features .on the 
photographic mat 34 printed or displayed in the eleventh 
embodiment. 

5 : Referring to Figure 45, in the eleventh embodiment, ithe 
pattern on photographic mat 34 comprises a plurality of 
clusters 3500-3550, of which there are six in this 
embodiment.-;. : 

10 Each cluster contains four features, each of which is a 

circle having either a large area or a small area, with 
a large area being twice that of a small area. ;: * In Figure 
45, a circle with "R" in, it is a red circle of large area 
on photographic mat 34 (that is, the letter; does not 

15 actually exist on photographic mat 34, and is only, used 

for labelling purposes in the drawing) a circle with V 
is a red circle of small area, a circle with "G" is a 
large green, circle, a circle with "g" is a small green 
- circle, a circle with "B" is a large blue circle, a 

20 circle with "b" is a small blue circle, a circle with "C" 

is a large cyan circle, a circle with "c" is a small cyan 
circle, a circle with "M" is a large magenta circle, a 
circle with M m" is a small magenta circle, a circle with 
M Y" is a large yellow circle, and a circle with "y" is a 

2 5 small yellow circle. 
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Within each cluster 3500-3550, the centres of the . four 
features are arranged on an imaginary straight line (that 
is, a line not present on photographic mat 34 - indicated 
at 3560 for cluster 3500). Within a given cluster, the 
centres of the four features are spaced equal distances 
apart on the straight line. 

The clusters 3500-3550 are arranged around .a central 
blank area 3570 which has a size such that a circle 
having the diameter stored at step S4 (Figure. 2) can be 
drawn therein without touching any of the features in the 

clusters 3500-3550. 

... . . - ' 

The processing operations performed in the elevenths 
, embodiment by feature detector 50 at step S32 in Figure 7- 
are the same as those performed in the first embodiment, 
with the exception that the processing performed at. step 
S50 in Figure 8 to generate a binary image from which to 
identify groups of pixels is slightly different. More 
particularly ■, rather than setting the value of each pixel 
in the input image to 1 or 0 in accordance with 
equation ( 1 ) above, in the eleventh embodiment, feature 
detector 50 sets the value of each pixel in accordance 
with the following equation: 
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If R< 128 or G< 128 or B< 128 set pixel value to /' 
%m ' \ else set the pixel value to 0 .....(10) 

Figure 46 shows the processing operations performed by 
feature clusterer 60 in the eleventh embodiment at step 
S34 in Figure 7. - ' • -' 4 y 

Referring to Figure 46, at step S1200, feature clusterer 
60 reads the colour of each feature (previously stored at 
step S60 in Figure 8) and plbts each feature as a point 
iri RGB colour space in dependence upon the colour of the 
■ 'feature. ' ' '* ' . * ' \ ' ' ' 4 "; 

As is well known to the skilled person, the colours, red, 
green, blue, cyan, f magenta, yellow, biack and white 
define the vertices of a cube in RGB colour space (as 
illustrated in Figure 47a* as cube 3600) . Accordingly, 
each point plotted at step S1200 by feature clusterer 60 
"will lie within the : cube 3600. Points resulting firom a 
feature on the photographic mat ,34 will lie at, or near 
to (due to errors), one of the red, green, blue, cyan, 
magenta or yellow vertices. Points resulting from a 
feature on the subject object 400 may lie anywhere in 
cube 3600, including at or near to one of the red, green, 
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blue, cyan, * magenta and yellow- vertices . 

At: step S1202, feature cluster 60 forms candidate 
clusters of features in dependence upon the feature 
positions in the RGB colour space determined at •: step 
S1200 . > 

More particularly, referring to Figure 47b; feature 
cliisterer 60 defines sub-regions 3610-3660 of the s RGB 
colour space cube 3600 and defines the candidate clusters 
from the features whose points plotted at step S1200 lie 
in the sub-regions 3610-3660. In this embodiment , each 
sub-region 3610-3660 comprises a cube having a " side 
length equal to one quarter that of the side length of 
cube 3600., and having one vertex which is the red, green, 
blue, cyan, magenta or yellow vertex of the cube 3600. 
To generate candidate clusters, feature clusterer 60 
. considers all of the points plotted at step S1200 lying 
in the red sub-region 36 10, and designates as a candidate 
cluster each possible group' of four features (since there 
are four features in each cluster 3500-3550 on 
photographic mat 34). This processing is repeated for 
each of the other colour sub-regions 3620-3660. to 
generate further candidate clusters . 
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Referring again to Figure 46, at steps S1204-S1226, 
feature clusterer 60 performs processing to test each 
candidate cluster of features set at step S1202 to 
determine whether, it represents .... a cluster* on , the 
photographic mat 34 . . . .... : r . „• , - . { .- 

More particularly, at step S1204, feature clusterer 60 
.considers the next candidate cluster of features 
generated at step . S 12-0-2 , and at step S1206 considers the 
two features in the - cluster which, have the^ greatest 
straight , : line distance, in the image therebetween. 
Accordingly, if the candidate -. cluster currently being 
considered is a cluster on the photographic mat 34 , then 
the two features considered at step S1206 will be the end 
features of the cluster in the, straight line.. 

At steps S1208-S1224, feature clusterer .60 performs 
processing to determine whether there are two, and only 
two, features lying on a straight line between .the two 
features considered at step S1206 and, if this is the 
case, whether the cross^ratio of the four features in the 
cluster is within a predetermined tolerance of the 
theoretical cross-ratio if the cluster represents a 
cluster on the photographic mat 34. Steps S1208-S1224 
are the same as steps S804 to S820 in the sixth 
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embodiment described above, and accordingly, will not: be 
described again here. - : 

At step S1226, feature clusterer 60 determines whether 
there is another candidate . cluster of features to be 
tested. Steps S1204 to S1226 are repeated until each 
candidate cluster has been processed in the way desicribed 
above. Accordingly, as a result of performing this 
5 * processing, feature clusterer 60 has tested each 
candidate cluster and retained those clusters having 
features which satisfy the relationship that there are 
- four: features lying in a straight line, and the positions 
*' ' of the features are such that the cross-ratio is 
substantially the same as that of the cross-ratio- for a 
cluster of features on the photographic mat 34. 

: ) • 

- • j 

Figure 48 shows the processing operations performed in 
the eleventh embodiment by feature identifier 70 at step 
S36 v in Figure 7. 

Referring to Figure 48, at step S1240, feature identifier 
70 considers the next cluster of features, and at step 
S1242, reads the sizes of the features and the colour of 
the features (previously stored at steps S56 and*S60 
respectively in Figure 8). 
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At step S1244, feature identifier 70 labels the feature 
having the smallest size as corresponding to the smallest 
feature on the photographic mat 34 having the colour read 
at step S1242. More particularly, by way of example, if 
the colour read at step S1242 is red, then at step S1244, 
feature identifier 70 labels the smallest feature in the 
cluster in the input image as feature 3562 on 
photographic mat 34. . 

••v At= step S1246; feature identifier 70 labels each of the 
larger features in the cluster in dependence upon their 
relative distances: from the smallest feature labelled at 
step.S1244. More particularly, by way of example, if the 
smallest feature is labelled as feature 3562 at step 
S1244, then, at step S1246, feature identifier 70 labels 
the closest feature thereto in the cluster as feature 
3564, the next closest feature thereto as feature 3566, 
and: the furthest feature in the input image as feature 
3568 on the photographic mat 34. 

At step S1248, feature identifier 70 stores, for each 
feature in the cluster, the coordinates of the feature's 
unique point position in both the image and the mat. 
This processing corresponds to step S148 in Figure 12. 
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At step S1250, feature identifier 70 determines whether 
there is another cluster to be .labelled. Steps S1240 to 
S1250 are repeated until each cluster has been processed 
in the way described above* 

A number of modifications can be made to the embodiments 
described above within the scope of the claims i 

For example, different features and/or clusters of 
features may be provided on photographic mat 34. V. In 
: particular , the clusters can be made up of different 
. numbers. of features, and the features can have different 
\ colours, shapes and/or sizes to those described in the 
embodiments above. 

For example, features of a given colour, features of a 
given ; size. and features of ( . a : given shape -V are 
interchangeable. For example, Figure 49 shows a 

photographic mat 34, which corresponds to the 
photographic mat in the third embodiment above (shown in 
Figure 23), but with the exception that a green circle 
1100 is provided in place of red cross 800 and a blue 
circle 1110 is provided in place of black cross 804. The 
green circle 1100, blue circle 1110, black circle 1120 
and red circle 1130 can be distinguished from each other 
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on the basis of colour. • 

Similarly, Figure 50 shows an example of a photographic 
mat 34 which corresponds to the photographic mat 34 in 
the fourth embodiment above (shown. in Figure 21) , but in 
which each red circle in the photographic mat in the 
fourth embodiment is replaced by a black cross. In 
images of the photographic mat shown in Figure 50 , the 
circle features and cross-features can be distinguished 
from each other on the basis of shape, as described above 
in the third embodiment. 

Of course, features having shapes other than crosses and 
circles may be used on photographic ma,t 34. 

In addition, rather than using different colours of 
features on the photographic mat 34, different shades of 
grey may be used. Accordingly, the term "colour* used 
herein encompasses black arid different shades of grey . 

Further, a, feature on the photographic mat may comprise 
the intersection of two lines, and the feature may be 
detected in an image by first performing processing to 
detect lines,, and* then performing processing to detect 
the intersection of the lines. 
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Clusters may be provided on photographic mat. 34 : with 
relationships between the features therein which are 
different to the relationships described above, to detect 
candidate clusters of features in an image and to test a 
candidate cluster to . determine, whether : qr. . not it 
corresponds to a cluster on the photographic mat. These 
relationships between .the features may be based on 
different positions, connectedness, colours, shapes 
and/or sizes of the features. 



For example, in the ninth embodiment described above, the 
relationship used to detect candidate clusters of 
features in an image is the relationship that the 
features in a cluster on the photographic mat 34 all lie 

15 within an area of solid colour (the features being holes 

. in this area in the ninth embodiment). However, instead, 
. the .pattern on photographic mat 34 .may comprise. features 
lying in any detectable area. For example, clusters may 
be provided each of which comprises a rectangle (or other 

20 shape) defined by black lines and features comprising 

circles . corresponding to the holes in the ninth 
embodiment may be provided within the area defined by the 
black lines of the rectangle, such that each circle has 
a size which is the same as that of the corresponding 

25 hole in the ninth embodiment, but has. a colour which 
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corresponds to the colour of the area in which the hole 
lies in the ninth embodiment. Candidate clusters could 
then be detected by performing processing to detect lines 
and. considering as a candidate cluster the features which 
lie within the area defined by connected lines. 

In the embodiments described above, processing is carried 
out to detect candidate clusters of features , and 
subsequently processing is carried out to test each 
.candidate cluster to; . determine whether or not- it 
represents a cluster of features on the photographic 
mat 34.; However f . instead of detecting, all candidate 
clusters first and subsequently testing them, a candidate 
cluster may be detected and tested before detecting and 
testing the next candidate cluster. > 

The number of features- on a photographic mat 34 may be 
more, or less than the numbers in the embodiments 
described above. The more features that are present on 
photographic mat 34, the more features that will be 
visible in each input, image. Further, for each feature 
in an input image which is labelled (that is for which 
the corresponding feature on the photographic mat 34 is 
identified.) the more correspondences there will be 
available to camera calculator 80 to calculate the* 
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position and orientation of the camera 410 for the input 
image, thereby improving the accuracy of the calculated 
position and orientation. However, as the number of 
features on the photographic mat 34 is increased, it must 
5 still remain possible to assign a unique label to each 

feature in an input image (and hence it may be. necessary 
to increase the number of different colours, shapes, 
sizes etc of features) and the possibility that two or 
more features may blend together for certain positions 
10 and orientations of the photographic mat 34 relative to 

camera 410, and hence appear as. a single feature in an 
input image so that the separate features can not be 
■> resolved, - increases . y'- ■ \. 

15 In the sixth embodiment above, at steps S872 to S892 

(Figure 35), each feature in a cluster in an image which 
has been determined to correspond to a feature on the 
photographic mat is labelled in dependence upon the 
relative sizes of the features in the cluster. However, 

20 instead, the pattern on the photographic mat may be 

changed so that the distances between the centres of the 
features is different for each cluster so that each 
cluster has a different cross-ratio as defined by 
equation (8) above. In this way, each feature may be 

25 labelled on the basis of the different cross-ratios for 
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• . each cluster . - : - .. v ;. 

In the embodiments described above, the one-to-one 
correspondence between the centre of a feature in the 
:v input image and the centre of a feature on photographic 
mat = 34 is > identified. However, the one-to-one 

correspondence between a point position other than the 
feature centre may be identified/ For example, the 
features on the photographic mat 34 may not be circles 
arid accordingly the unique point position of each group 
may not be the centre of the group of pixels. More 
particularly, if, for example, a feature on the 
photographic mat A 34 is an isosceles triangle, the unique 
point position may be the vertex of the triangle where 
the two longest sides meet. All that is necessary is 
that each feature on the photographic mat 34 has 
associated therewith a unique point position on the mat, 
for which the position is defined and stored at step S6 
(Figure 2) and each group of pixels (representing a mat 
feature) is processed at step S58 (Figure 8) (or the 
corresponding step) to determine the position in the 
image of the unique point position for the group. 

In the embodiments described above, at step S36 
(Figure 7) a one-to-one correspondence is defined for the 
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unique point position of each feature in the input image 
which represents a feature on the photographic mat. 
However, instead, the features in a cluster detected in 
the input image may be used to define a further point in 
the image, - and the point on the photographic mat 
corresponding to the further point may be determined. 
For example, referring to the first embodiment above, the 
four features in a cluster detected in an input image may 
be connected by diagonal lines (lines 630 and 632 in 
Figure 14a) , -with the intersection of the lines defining 
a further position in the input image. This further 
position may then be labelled to correspond to ; a position 
on the photographic mat 3.4. - .In this specific example, 
the number of further points determined for a cluster is 
less than the number of features in the cluster, which 
reduces the number of one-to-one correspondences 
available *to. calculate the position and orientation of 
camera 410. However, the features in a cluster may be 
used to calculate the position of more further* points 
which can be labelled as corresponding to a point oh the 
photographic -mat. 

In some of the embodiments above (for example the first 
to fifth embodiments), the clusters of features are 
typically arranged in a geometrical shape (a circle or 
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triangle). .Instead/- the clusters., can be arranged; in 
"random" positions relative to each other. However, .the 
point position of each feature on the photographic mat 34 
needs to be known- In addition, in embodiments where a 
^predetermined reference point heeds to be identified in 
an input image in order to label clusters and/or 
features, then it is necessary that the clusters are 
arranged to allow this predetermined point to be found, 
or that some other, means is provided to allow the 
predetermined point to be found (for example, the point 
itself may be marked on the photographic mat so that the 
mark can be found in the input image) . 

In the first and third embodiments described above, the 
predetermined point on the photographic mat 34 which is 
identified in an input image at step S140 (Figure 12) is 
the centre of the circle on which the clusters on fthe 
photographic mat lie. However, instead, : any 

predetermined point which allows features and/or clusters 
as necessary to. be labelled may be used. Similarly, the 
predetermined reference point in the sixth and tenth 
embodiments may be different to that described above. 

In some of the embodiments described above, the features 
on the photographic mat 34 are arranged around an empty 
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space in which the object 400 to be modelled is placed. 
However/ the features may be provided over photographic 
mat 34 without a space for object 400, and object 400 may 
then be placed over some of the features. However, a 
minimum of 6 features should be visible in each input 
image. : . - : 

In addition, if it is' not necessary to generate a 3D 
computer model of the whole of an object 400 , then it is 
unnecessary to provide features on photographic mat 34 
which surround, the object- : ; 

Further, the object 400 does not need to be placed on the 
photographic mat 34. For example, the object 400 may be 
placed along side the mat and images recorded so that at 
least part of the object and mat are visible in each 
image/ ' Accordingly/ the ; photographic mat 34 does not 
need to be in a horizontal plane (it could, for example, 
be hung in a vertical plane behind the object 400). 

In*addition> the calibration pattern may be attached to 
the subject object, and the camera 410 moved relative to 
the subject object with the calibration pattern thereon 
to record the images at different positions and/or 
orientations. For example, one or more calibration 
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objects in -the form of a flat - photographic mat may be 
attached to different surfaces of the subject, object. 

In the embodiments described above, printer 8 prints 
photographic mat 34 in accordance with the requested 
diameter input by a user and stored at step S4 
(Figure 2). If. the diameter is so large that a 
photographic mat 34 ckn not be printed on a single sheet 
of paper with the clusters of features spaced apart 
sufficiently to allow the object 400 to be< placed within 
them, then mat generator 30 may control printer 8 to 
print the photographic mat on separate sheets of paper , 
which can then be placed together to form the 
photographic mat 34. Figure 51 shows an example in which 
clusters of features forming part of photographic mat 34 
are printed on four separate sheets of paper 1200 , 1300 , 
1400 and 1500, which are then placed together to form 
photographic mat 34. 

In addition , clusters of features may be printed on 
separate sheets of paper but, instead of assembling the 
separate sheets of paper to form a photographic mat 34 so 
that the features in the pattern are at known 
predetermined positions stored in processing apparatus 2, 
the separate sheets of paper with the clusters of 
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features thereon may be placed around the subject object 
at positions and orientations chosen by the user so that 
the positions of the clusters relative to each other are 
not known. In such an embodiment, the processing 
5 operations performed by mat generator 30 and camera 

calculator 80 are different to the processing operations 
in the embodiments described previously. 

More particularly , referring to Figure 53, mat generator 
10 30; causes printer 8 to print separate sheets of paper, 

each having thereon a different cluster of features from 
. a .calibration pattern. In the example shown in Figure 
. .53, six sheets of paper 4000-4050 are printed and the 
clusters 3100-3110 from the seventh embodiment are 
15 printed on the sheets. The printed sheets, are, then 

placed at user-selected positions and orientations around 
a subject object 4200. for which a 3D computer model, is to 
be generated. Accordingly, in this embodiment, the 
processing previously described at steps S2 and S4 in 
20 ; Figure 2 to request and store a diameter of the 

photographic mat is unnecessary. 

Images of the subject object 4200 and the calibration 
pattern formed by the clusters of features 3100-3110 on 
25 sheets 4000-4050 are recorded at different positions 
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atnd/or orientations by moving the imaging camera relative 
to. the subject object- 4200 and the sheets of paper 4000- 

4050. : 

■/ Figure 54 shows . the processing operations performed at 
step S14 (Figure 6) to process the -recorded images to 
calculate the imaging positions and orientations - 

Referring to Figure 54, the processing performed at steps 
: S1300> S1302, S 1304 and S1306 is the same as the 
; processing performed at steps S30, S32, " S34 and S3 6 
> respectively in the seventh embodiment, and accordingly 
. - will not be described again here . : - — 

.However, because the relative positions of the clusters 
3100-3110 around the subject object 4200 are not known, 
unlike in, the . seventh embodiment, processing is not 
performed to calculate the position and orientation of 
the input image relative to a predetermined stored 
calibration pattern. Instead, as will be explained 
below, processing is performed to calculate the positions 
and orientations of the input images relative to each 
other. 

More particularly, at step S1308, processing apparatus 2 
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.* determines whether there . is another input image; to 
process/ and steps S1300 to S1306 are repeated until each 
input image has been processed. 1 Accordingly , after this 
processing has been completed (that is., when it is 
5 determined at step S1308 that no further input images 

remain to be processed), each feature from a cluster; 
3100-3110 appearing in an input image has been labelled 
and its position in the input image has been determined. 
The labelled features therefore define features in 

10 .different input images which correspond to each other, 

that is, features which match between the different input 
images. This is because, labelling a feature in an input 
image defines a one-to-one correspondence between the 
feature and a feature in the calibration pattern, so that 

15 ' - features in different input images which have the same 
label are matching features because they correspond to 
~ the same feature in the calibration pattern. 

At step S1310, camera calculator 80 performs processing 
2 0 to calculate the relative position and orientation of the 

camera for each input image using the features identified 
at step S1306 as matching features in the input images. 

Many techniques are known for calculating relative 
2 5 imaging positions and orientations once matching features 
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in input: images have been detected. For example, 
suitable processing is described in EP-A-0898245 and EP— 
- A-0901105. 

In summary, therefore, the calibration object comprises 
a plurality of pieces, each piece having a cluster of 
features thereon. The clusters of features are provided 
around, the , subject object 4200, as in previous 
* embodiments, and advantage is taken of the properties of 

/ the features inrthe cluster to distinguish features which 
are part of a cluster (and hence part of the calibration 
pattern) from features which .are part of the subject 
object, and to - enable • the features to be- uniquely 
identified. However, because the relative positions of 
the clusters: are not known, processing is not performed 
as in previous embodiments to calculate the imaging 
positions and orientations for an input image relative to 

. . a known, stored calibration pattern, but instead the 
: input images are .processed to calculate - the imaging 
positions and orientations relative to each other. 

In the example shown in Figure 53 and described above, 
clusters of features from the calibration pattern in the 
seventh embodiment are described. However, clusters of 
features from calibration patterns in any of the other 
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embodiments described above may be used. In embodiments 
where it is necessary to determine a predetermined point 
in order to label the features within a cluster, it is 
necessary for the user to arrange the separate sheets of 
5 paper on which the clusters are printed around the 

subject object so that each cluster has- the required p , 
orientation relative to the predetermined point. More 
particularly , referring to the sixth embodiment by way of 
example, the calibration pattern for which is shown in 
10 Figure 31, fifteen sheets of paper would be printed, each 

with a respective one of the clusters 3000-3028 thereon, 
and the sheets of paper would be arranged around the;, 
subject object so that a straight line passing through^ 
the centres of the circles in each cluster passes through.^ 
15 a predetermined point (3050 in Figure •31) . The- 

predetermined point could be marked on the surface on 
which the sheets are arranged thereby enabling the user 
to achieve the correct alignment of each cluster with the 
marked point. In embodiments in which processing is 
2 0 performed to predict the position of a cluster in an 

input image on the basis of a detected cluster (for 
example the first, second and third embodiments), the 
user must arrange the printed sheets so that they are at 
predetermined positions relative to each other within a 
25 given tolerance. 
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In the example described above with reference to Figure 
53 > a respective cluster of features is printed on each 
sheet of paper. However, each feature in the calibration 
pattern may be. provided separately, and the separate 
features can then be positioned to form a calibration 
-pattern- For example, each feature may be printed on a 
different sheet of paper or separate disks (or other 
shapes) of card, or other suitable material, may be 
provided, so that each disk can act as a feature in the 
calibration pattern. - v: 

In all of the embodiments above, rather than printing the 
photographic mat on a recording medium or displaying the 
photographic mat oh display panel 10, the features of the 
photographic mat may be marked (for example painted) , 
projected or otherwise represented on a surface such as 
a floor. or field for the object to be placed therein. 

-The display panel 10 could comprise any form of display 
apparatus for displaying the pattern of the photographic 
mat. for example/ the display panel 10 could comprise 
the display of monitor 4 , which could be turned* so that 
the display is horizontal if the object is to be placed , 
on the photographic mat, or could be placed behind the 
object so that the display is in a substantially vertical 
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plane . < ' 

In the embodiments described above, the calibration 
object which is imaged with the object 400 has the form 
of a two-dimensional photographic mat 34 . ... '.Hqweveac, 
instead of photographic mat, 34, a three-dimensional 
calibration object may be used. For example, mat 
generator 3 0 may control printer 8 to print patterns of 
features on separate sheets, and the sheets may then be 
folded into, or attached to, a three-dimensional- object, 
such as a cube. 

Figures 52a and 52b' illustrate an example in which ■ the 
pattern of features in the fifth embodiment described 
above is applied to a three-dimensional calibration 
object. 

More particularly, referring to Figure 52a, mat 
generator 30 causes printer 8 to print a pattern of 
features comprising clusters 1000-1014 on a sheet of 
paper 2000, a pattern comprising cluster 1016 on a 
sheet 2100, a pattern comprising cluster 1018 on a 
sheet 2200, a pattern comprising cluster 1020 on a 
sheet 2300, and a pattern comprising cluster 1022 on a 
sheet 2400. Thus, five sheets are printed, with each 
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sheet showing at: least. one cluster of features. 
Sheet 2000 is attached to the top surface of a cube 2500 , 
and sheets 2100, 2200, 2300 and 2400 are attached to the 
. side faces of the cube 2500. As the bottom face of 
cube 2500 rests on surface 380, it can not be seen in any 
images , and it is not therefore necessary to provide a 
pattern of features on this bottom surf ace, . 

The cube 2500 with the sheets 2000-2400 attached can 
therefore be ; used as a three-rdimensional calibration 
object. : \ . .«■".... : 

More particularly , referring to Figure 52b, object 400 is 
. placed on the top surface of cube 2500 in the central, 
blank area of sheet 2000 which is surrounded by the 
clusters 1000-1014. 

i • 

As in the embodiments described above, cube 2500 can be 
moved : and rotated relative to the camera 410 to record 
images of the object 400 at different positions and 
orientations. 

By using a three-dimensional calibration object, features 
can be provided in planes other than the plane on which 
the object 400 sits, and accordingly the visibility of 
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, . the features in. these planes may be increased, providing 
more one-to-one correspondences with which to calculate 
the i imaging position and orientation, and hence 
increasing the accuracy of the calculated position and 
5 orientation, . . • 

The object 400 does not need to be placed on the 
calibration object , but instead , may be placed along side 
the object and images may be recorded so that, at least 
10 part of: the object .400 and calibration object are visible 

in each image. 

tin. the- embodiments .above, the images input to processing 
apparatus 2 are recorded by moving the photographic 

15 mat 34 (or cube 2500) with object 400 thereon relative to 

camera 410. However, instead, camera 410 may be moved 
relative to the photographic mat 34 (or cube 2500) and 
object 400, or both the camera 410 and the photographic 
* mat 34 (or cube. 2500) with object 400 thereon may be 

20 moved. 

In the embodiments described above, at step S12 
(Figure 6) data input by a user defining, the intrinsic 
parameters of camera 410 is stored. However, instead, 
25 default values may be assumed for some, or all, of the 
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intrinsic camera parameters, or processing; may be 
performed to calculate the intrinsic parameter values in 
a conventional manner, for example as described in 
"Euclidean Reconstruction from Uncalibrated Views" by 
Hartley in Applications of Invariance in Computer Vision, 
Mundy, Zisserman and Forsyth eds, pages 237-256, Azores 
: \ 1993. ■ ■ . • v 

At step S56 and step S58 (Figure 8) described above/ 

feature detector 5 0 stores the number of pixels in each 
- group of pixels and calculates and stores the centre of 
.gravity of each group. However -, this processing may be 
... performed as part of step S52> by keeping a running total 

of the number of pixels in each group together with the 

"x" and "y" coordinates of the pixels. 

v. At steps S82 to S98 (Figure 9) described above, features 
which lie in the input image within the largest span 
distance of each of three features in a set are processed 
to try to form a set of four features. However, rather 
than considering only features which lie within the 
largest span distance from each of the three features, 
step S82 may be omitted and at steps S86 to S98, every 
feature in the input image may be considered for addition 
to the three features in the set remaining after step S80 
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has been performed. 

In the embodiments described above, image data from an 
input image relating to the object 400 is segmented from 
the image data related to the photographic matv.-34 and 
background as described with reference to Figure 19. 
However, other conventional segmentation methods, may be 
used instead. For example, a segmentation method may be 
used in which a single RGB value representative of the 
colour of the photographic mat 34 and background, is 
stored and each pixel in an input image is processed to 
determine whether the Euclidean distance in RGB. space 
. between the RGB background value and the RGB pixel" value 
is -less than a specified threshold. 

in the embodiment described above, after the position and 
orientation of the camera 410 has been determined for 
each input image, processing is performed to generate a 
3D computer model of the object 400. However, the 
position and orientation of the camera may be used for 
different applications. For example, the calculated 
camera positions and orientations may be used to add 
synthetic objects to a video sequence, the positions and 
orientations of the cameras being needed to register the 
positions and orientations of the synthetic objects; 
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In /the embodiments ; described above , processing 
apparatus 2 may be connected to printer 8 or display 
panel 10 via a communication link such as the Internet, 
and image data recorded by camera 410 may be sent to the 
,* processing apparatus 2 over the, communication link., . 

In the embodiments described above, the components of 
processing apparatus 2 may , be provided in camera 410 or 
printer 8. , - 

In the embodiments described above, mat; generator 30 may 
be ; provided as a separate apparatus, from. the- other 
components of processing apparatus 2. For example/ mat 
generator 3 0 may be provided in camera 410 or may be 
provided in printer 8. Data defining the mat which mat 
generator 30 r caused to be printed or displayed would then 
• .-.be input to processing apparatus 2, . - 

In the embodiments described above, images of the subject 
object 400 and calibration object 34 are recorded using 
visible light and processing is performed on the visible 
light data. However , light of other wardlengths may be 
used, for example, infrared or ultraviolet light. 



In the embodiments above, data defining the calibration 
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object 34 may be provided to a user as pixel data on a 
storage device or conveyed by a signal for printing. 

In the embodiments described above , at steps S16 to S20 
processing is performed . to generate data defining a 3D 
computer model of the : subject object , and at step S22 
images of the 3D computer model are displayed. However, 
in addition, or instead, the imaging positions and 
orientations calculated at step S14 may be used to 
control manufacturing equipment to manufacture a physical 
model of the subject object. For example, data may be 
generated to control a -cutting apparatus to cut material 
to the appropriate, dimensions to model the subject 
object. 

In the embodiments described above, processing is 
performed by a computer using processing routines defined 

by programming instructions. However, some, or all, of 

■t • 

the processing could be performed using hardware. 
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' ' - / v— ,> CLAIMS v • - • : • / 

1 An image processing system for recording images of 
a - subject object from different positions -and 
orientations and for processing recorded image data to 
determine the positions and orientations at which the 
images were recorded, the system comprising: 

a calibration object for imaging with the subject 
object, the calibration object having a pattern 
• comprising a plurality of discrete featured with each 
■"•feature defining a respective position on the calibration 
object, at least some' of the features being grouped into 
clusters such that the features in a given cluster 
satisfy at least first and second cluster relationships, 
each cluster relationship based oh at least one of the 
colour, shape, size, position and connectedness of the 
- -features in the cluster; 

imaging means for recording images showing at least 
part of both the subject object and the calibration 
object in each image; and 

image data processing means for processing image 
data recorded by the imaging means to determine the 
positions and orientations of the imaging means when the 
images were recorded, the .image data processing means 
comprising: 
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means for processing image data defining an image to 
detect candidate clusters of features in the image which 
may represent clusters of features on the calibration 
object on the basis of at least the first cluster 
5 relationship; 

'means for processing candidate- clusters., to 
distinguish clusters in the image in which all 6f the 
features represent features on the calibration 6b ject 
from clusters containing at least one feature in the 
10 image representing a feature not- on the calibration 

object by determining which candidate clusters contain 
features satisfying . at least the second cluster 
relationship; / 

• means for allocating a one-to-one correspondence 
15 between at least some points in the image and points on 

the calibration object itself; and 

means for calculating the position and orientation 
at which the image was recorded on the basis of at least 
some of the one-to-one correspondences 

20 

2. An image processing apparatus for processing image 
data recorded by imaging means defining an image of at 
least part of a subject object and a calibration object 
having a pattern comprising a plurality of discrete 
25 features with each feature defining a respective position 
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oh the calibration object/ at least some of the features 
being grouped. into clusters such that the features in a 
given cluster satisfy 'at least first and second cluster 
relationships/ each cluster relationship based on. at 
least one of the colour, shape, size, position and 
connectness of the features in the cluster, to calculate 
the position and orientation of the imaging means when 
the image Vas recorded, the apparatus comprising: 

means for processing image data defining an image to 
detect candidate clusters of features in the image- which 
may* represent clusters of features on the- calibration 
object on. the basis ; of at least the first cluster 
relationship; , 

means for processing candidate clusters to 
distinguish - clusters in the image in which all of the 
features represent features on the calibration object 
from clusters; containing at least one feature in the 
image representing a feature not on the calibration 
object by determining which candidate clusters contain 
features satisfying at least the second cluster 
. relationship; 

means for allocating a • one-to-one correspondence 
between at least some points in the image and points on 
the calibration object itself; and 

means for calculating the position and orientation 
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at. which the image was recorded on the basis of at least 
some of the one-to-one correspondences. 

3. Apparatus according to claim 2, wherein the means 
for processing image data to detect candidate clusters 
comprises : 

;pixel detecting means for processing the image data 
to detect groups of pixels defining features in the image 
which may represent features on the calibration object; 
and : - 

cluster detecting means for grouping at least some 
of the features detected by the pixel detecting means 
into candidate clusters. ..... ' 

4. Apparatus according to claim 3 , wherein the pixel 
detecting means comprises: 

means for detecting pixels of predetermined colour; 

and 

means for detecting groups comprising detected 
pixels which are connected in the image. - 

5. Apparatus according to any of claims 2 to 4, wherein 
the means for allocating one-to-one correspondences 
comprises means for allocating one-to-one correspondences 
between at least some features in the clusters in the 
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image determined to represent a .cluster on the 
calibration object and features on the calibration object 
itself. 

6; Apparatus according to any of claims .2 to 5 , wherein 
...*. at least some of the features or clusters on: the 
calibration object are visually distinguishable from the 
others , and wherein the means for allocating one-to-one 
* correspondences comprises means for performing processing 
using the features or clusters in the image possessing 
the distinguishing characteristics to allocate the one- 
to-one correspondences; *. .'. ... - / ; 

7* Apparatus according to claim 6, wherein all of the 
features in at least some of the clusters on the 
calibration object are substantially identical, and 
wherein the means for allocating one-to-one 
correspondences is arranged to allocate, the one-to-one 
correspondence for a said substantially identical feature 
in dependence upon a feature, or cluster possessing 
distinguishing characteristics. 

8- Apparatus according to any of claims 2 to 6, wherein 
the means for allocating one-to-one correspondences is 
arranged to - allocate at least some one-to-one 
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correspondences in dependence upon positions of features 
in the image relative to the position in the image of a 
reference point on the calibration object. 

5 9. Apparatus according to any of claims. 2 to . 8, wherein 

the . means for allocating one-to-one correspondences is 
arranged to allocate , at least some one-to-one 
correspondences by: ' 

determining a one-to-one cluster correspondence 
10 between a given cluster in the. image determined: to 

represent a cluster on the calibration object and a 
.cluster on the calibration object itself; and./ 

determining a one-to-one feature correspondence 
between features in the image in the given cluster and 
15 features on the calibration object using the pne-to-one 

cluster correspondence. 

10. Apparatus according to claim 9, wherein the, means 
for allocating one-to-one correspondences is arranged to 
20 determine a one-to-one cluster correspondence in 

dependence upon the relative positions within the cluster 
of predetermined features. 

11.. Apparatus according to claim 10, wherein the means 
25 for allocating one-to-one correspondences is arranged to 
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determine a. one-to-one cluster correspondence in 
dependence upon the positions within the cluster -of the 
predetermined features relative to the position in the 
image of a reference point on the calibration object* 

12. Apparatus- according to any of claims 2 -to 6, and 8 
to. 11, wherein the pattern on the, calibration -object 
comprises a plurality of clusters each containing ..the 
same predetermined number of features arranged in a « 
r e spective . straight line , and wherein the means for 
detecting candidate; clusters is arranged to process, the 
image data to detect clusters comprising j the 
predetermined number of features which lie on a straight 
line in the image. ^ : 

13. Apparatus according to claim 12, wherein the 
features in the clusters on the calibration object, are 
arranged at predetermined relative spacings along, the 
respective straight lines, and wherein the means for 
processing the candidate clusters is arranged . to 
determine whether the features in a candidate cluster, 
have the relative spacings in the image. 

14. Apparatus according to claim 12 or claim 13, wherein 
the means for allocating one-to-one correspondences is 
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arranged to allocate the one-to-one correspondences in 
dependence upon the relative sizes of the features iri a 
cluster. 

5 15. Apparatus according to any preceding claim, wherein 

the calibration object comprises a plurality of parts, 
each part having thereon at least one feature of the' 
pattern. • > - . . .+ - ' 

10 16. Apparatus according to claim 15, wherein each part 

of the. calibration object, has thereon at least one 
. - cluster of features. : ♦ , - • • 

17. Apparatus according to any preceding claim, wherein 
15 the means for calculating the position and orientation at 

--. which the image was recorded is arranged to calculate the 
position and orientation relative to a predetermined 
configuration of the pattern on the calibration object. 

20 18. Apparatus according to any of claims 1 to 16, 

wherein the means for calculating the position and 
orientation at which the image was recorded is arranged 
to calculate the position and orientation relative to the 
position and orientation at which- a further image of the 

2 5 subject object and calibration object was recorded. 



j 
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19. Apparatus according to claim 18; wherein the means 
for calculating the position and orientation at which* the 
image was recorded is arranged to calculate the position 
and orientation relative to the position and orientation 
of the r further image by using the one-to-one 

.correspondences to determine matching features* in the 
-image and the further image arid using the matching 
features to calculate the relative positions and 
orientations at which the image and the further image 

• were recorded. ■ - ' • ; - ff 

20. An image processing apparatus for processing image 
- data defining an image of at least part of a 1 subject 

object and a calibration pattern comprising a plurality 
of features each having a different position in the 
pattern, at least some of the features being visually 
substantially identical and at least sonie of the features 
being grouped into clusters on the basis of at least two 

• properties of the features, to calculate the position and 
orientation of the imaging means when - the object was 
imaged, the apparatus comprising: 

means for processing the image data to generate 
candidate clusters of features therein, wherein the 
features in each candidate cluster have a first property; 

means for determining which of the candidate 
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clusters comprise features which also have the second 
property; 

means f or determining a plurality ~ of : bhe-to-one 
correspondences between points in the image and points in 
5 the calibration - pattern using the clusters, in .the image 

determined to comprise features having both the first and 
second properties; and 

' means for determining the position and orientation 
of the imaging means when the object was imaged using at 
10 least some of the determined one-to-one correspondences. 

21. - A method of- recording images of a subject object 
.from different positions and orientations and processing 
w recorded image data - to determine the positions . and 
15 orientations- at which the images were recorded, 

comprising: . 

recording images showing at least part of both the 
.. subject object and a calibration pattern in each image, 
the calibration pattern comprising a plurality of 
20 discrete features with each feature defining a respective 

position in the pattern, at least some of the features 
being grouped into clusters such that the features iri a 
given cluster satisfy at least first and second cluster 
relationships, each cluster relationship based on at 
25 least one of the colour, shape, size, position and 
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connectedness of the; features in the cluster; and 

processing the image data for a given image to 
determine the position and orientation at which the image 
was recorded by: ; * 

5 processing imag? data defining "the image to detect 

candidate clusters of; features in the image which may 
represent clusters of features in the calibration pattern 
on the basis of at least: the first cluster relationship; 
processing candidate clusters to distinguish 
10 clusters in the image in which all of the features 

represent features ;in the calibration pattern from 
r - clusters containing at least: one feature in the image 
representing a feature not in the calibration pattern by 
determining which candidate clusters contain features 
15 satisfying at least the second cluster relationship; 

allocating a one-to-one correspondence between at 
least some points in the image and points -in* the 
calibration pattern itself ; and 

calculating the position and orientation at which 
20 the image was recorded on 'the basis of at least some of 

.J- the one-to-one correspondences. 

22. An image processing method of processing image data 
recorded by imaging means defining an image of at least 
25 part of a subject object and a calibration pattern 
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comprising a plurality of discrete features with each 
feature defining a respective position in the pattern, at 
least some of the features being grouped into clusters, 
such that the features in a given cluster satisfy at 
least ■ first and second cluster relationships, each 
cluster relationship based on at least one of the colour, 
shape, size, position and connectness of the features in 
the cluster, to calculate the position and orientation of 
the imaging means .when the image was recorded, the method, 
comprising: / * 

• processing image data defining the image to detect 
candidate clusters of features in the image which may 
represent. clusters. of features in the calibration pattern 
on the basis of at least the first cluster relationship; 

processing candidate clusters to distinguish 
clusters in the image in which all of the features 
represent features, in the calibration pattern • from 
clusters containing at least one feature in the image 
representing a feature not in the calibration pattern by 
determining which candidate clusters contain features 
satisfying at least the second cluster relationship; 

allocating a one-to-one correspondence between at 
least some points in the image and points in the 
calibration pattern itself; and 

calculating the position and orientation at which 
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■the image was recorded on the . basis . of at least some of 
: "the one-to-one correspondences. 

23.. A method, according to claim 22, wherein the step of 
processing the image data to detect candidate clusters 
comprises: , * ;--> : -;, " : 

processing the image data to detect groups of pixels 
defining features in the image which may represent 
^features in the calibration pattern; and 

: ^ ^ grouping at least some, of the features, detected in 
the, step of detecting groups of pixels into candidate 

• .-.••...••clusters...:;;. •. „ \ .->:..•.• •.♦• •;-. .V. ' \ . . r V . : . 

24y A method according to claim 23, wherein the step of 
detecting groups of pixels comprises: 

detecting pixels of predetermined colour; and 
detecting groups comprising detected, pixels -which 
are connected in the image. 

25. A method according to. any of . claims 22 to, 24, 
wherein the step of allocating one-to-one correspondences 
comprises allocating one-to-one correspondences between 
at least some features in the clusters in the image 
determined to represent a cluster in the calibration 
pattern and features in the calibration pattern itself . 
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. 26. A method according to . any of claims 22, to, 25, 
wherein at least some of the. features or clusters in the 
calibration pattern are visually distinguishable. from the 
others, and wherein the step of allocating one-to-one 
5 correspondences comprises performing processing using the 

features or clusters' in the image possessing the 
distinguishing characteristics to allocate the one-to-one 
correspondences, 

10 . . 27. « A method according to claim 26, .wherein all of the 
features . in at . least some of the clusters - in . the 
calibration pattern are substantially identical, : and 
wherein, in the step of allocating one-to-one 
correspondences, the one-to-one correspondence for a said 

15 substantially identical feature is -allocated in 

dependence upon a feature or cluster possessing 
distinguishing characteristics. 

28. A method according to any of claims 22 to 26, 
20 wherein, in the step of allocating one-to-one 

correspondences , at least some one-to-one correspondences 
are allocated in dependence upon positions of features in 
.the image relative to the position in the image of a 
reference point . in the calibration pattern. 
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29. A method according to any of claims 22 to 28, 
wherein/ in the step of allocating one-to-one 
correspondences at least some one-to-one correspondences 
are allocated by : . --V- • ■ 

determining a one-to-one cluster correspondence 
between a -given cluster . in the image determined to 
represent a cluster in the calibration pattern and .a 
cluster in the calibration pattern itself; and 

determining a one-to-one feature correspondence 
between features in the image in the given cluster and 
features in the calibration pattern using the one-to-one 
cluster correspondence. 1 .-.\* 

30. A method according to claim 29, wherein, in the step 
of 5 allocating one-to-one correspondences, a one-to-one 
cluster correspondence is determined in dependence upon 
the relative positions within the cluster of 
predetermined features. 

31. A method, according to claim 30, wherein, in the step 
of allocating one-to-one' correspondences, a one-to-one 
cluster correspondence is determined in dependence upon 
the positions within the cluster of the predetermined 
features relative - to the position in the image of a 
reference point in the calibration pattern. 
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32- A method according to any of claims 2 2 to 2 6 , and 28 
to 31 , wherein the calibration pattern comprises a 
plurality of clusters each containing the same 
predetermined number of features arranged in a respective 
straight line, and wherein, in the step of detecting 
candidate clusters, the image data is processed to detect 
clusters comprising the predetermined number of features 
which lie on a straight line in the image- 

33. A method according to claim 32, wherein the features 
in the clusters in the calibration pattern are arranged 
at predetermined relative spacings along the respective 
straight lines, and wherein, in the step of processing 
the candidate clusters, processing is performed to 
determine whether the features in a candidate cluster 
have the relative spacings in the image. 

34. A method according to claim 32 or claim 33, wherein, 
in the step of allocating one-to-one correspondences, 
one-to-one correspondences are allocated in dependence 
upon the relative sizes of the features in a cluster. 

35. A method according to any of claims 21 to 34, 
wherein the calibration pattern is provided on a 
plurality of separate objects, each object having thereon 
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at least one feature of the pattern. 

36. A method according to claim 35, wherein each object 
has thereon at least one cluster of features . 

3 7. A method according to any of claims 21 to- 36, 
wherein, in the * steps of calculating the position and 
orientation at which the image was recorded; the position 
and orientation is calculated relative to a predetermined 
configuration of the calibration pattern - 

. 38v * A method according, to any of claims 21 to 36, 
^ wherein > in the step of calculating the position and 
orientation at which the image was recorded, the position 
and orientation is calculated relative to the position 
and orientation at which a further image of the subject 
object and calibration pattern was recorded. 

39. A method according to claim 38, wherein, in the step 
of calculating the position and orientation at which the 
image was recorded, the position and orientation is 
calculated relative to the position and orientation of 
the further image by using the one-to-one correspondences 
to determine matching features in the image and the 
further image and using the matching features to 



! 



WO 01/391 24 PCT/GB00/04469 

* * 

227 

calculate the relative positions and orientations at" 
which the image and the further image were recorded. 

40. An image processing method for processing- image data 
5 recorded by an imaging means defining an /image of at 

least part of a subject object and a calibration object 
having a pattern comprising a plurality of/ features each 
having a different position on the calibration object, at 
least some of the features being visually. substantially 

10 identical and at least some of the features being grouped 

into dusters on the basis of at least two properties of 
i the features, to calculate the position and orientation 
of the imaging means when the image was recorded; the 
method comprising: 

15 processing the image data to generate . candidate 

clusters of features therein, wherein the features in 
each candidate cluster have first property; 

determining which of the candidate clusters comprise 
features which also have the second property; 

20 determining a plurality of one-to-one 

correspondences between points in the image and points on 
the calibration object using the clusters in the image 
determined to comprise features having both the first and 
second properties; and 

25 determining the position and orientation at which 
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' the image was recorded using at: least some of. . the 
determined one-to-one correspondences. 

41. •:• A method according to any of claims 22 to .40, 
- further-comprising generating a signal conveying the 

calculated position and orientation of the imaging means . 

42 . A method according to claim 41 , further comprising 
recording the signal either directly or indirectly . 

43. A method according to any of claims 22 to 42 , 
f urther comprising processing the image, data: to segment 
image data relating to the subject object, from, background 
image data. , 

44 . A method according to any of claims 22 to 43 , 
further comprising generating. data defining a 3D computer 
model of the. surface of the subject object using the 
calculated position and orientation of the imaging means . 

45. A method according to claim 44, further comprising 
generating a signal conveying the 3D computer model. 

46. A method according to claim 45, further comprising 
recording the signal either directly or indirectly. 
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47. A calibration object for. use in a system according 
to claim 1 or a method according to claim 21 having a 
pattern comprising a plurality of discrete features with 
each feature defining a respective position on the 

5 calibration object, at least .some of the features being 

grouped into clusters such that the features in a given 
cluster satisfy at least first and second cluster 
relationships, each cluster relationship based on at 
least one of the colour, shape, size,' position and 
. 10 connectness of the features in the cluster. 

48. - A calibration object* according to claim 47 wherein 
all of the features in at least some of-the clusters are 
substantially identical. 

15 

49- A calibration object according to claim 47 or claim 
48, wherein at least some of the features or clusters are 
visually distinguishable from the others. 

20 50. A calibration object according to claim 49, wherein 

at least some of the clusters are visually 
distinguishable from each other on the basis of the 
relative positions within each cluster of predetermined 
features. 



25 
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• 51 . A calibration ob ject: according to claim 50 ^ wherein 
-the relative positions are determined from a reference 
point on the calibration object. 

; 52. A calibration object according to any of -claims 47 
-and 49 to 51 , wherein the pattern on the calibration 
object comprises a plurality of clusters each containing 
the same predetermined number of features arranged in a 
respective straight line. 

53 . A calibration ob ject according to claim 52 , wherein 
the features are equally spaced along the respective 
v straight lines . : .r ; •* ; 

54. A calibration object according to claim 52 or claim 
53 wherein the respective straight lines are radii of a 
common circle. . - v ... ^ 

55. A calibration object according to any of claims 52 
to 54 , wherein the features in at least some of the 
clusters comprise features of different sizes. 

56. A calibration object according to any of claims 47 
to 55 , when embodied as a three-dimensional object. 
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57. A calibration object according to any of claims 47 
to 55, when embodied as a -photographic mat. . 

58. A photographic mat according to claim 57, wherein 
the features are arranged around a central \aire.aL in which 
the subject object is to be placed. 

59. A photographic mat according to claim 57 or claim 
5 8 when embodied as a recording medium on . which the 
pattern is printed.* 

: 60. A photographic mat according to claim 5 9/ wherein 
the pattern is printed on a plurality of sheets of 
recording medium. > 

61; A photographic mat according to claim 57 or. claim 
58, when embodied as a display device displaying the 
pattern. 

62. A calibration object for use in a system according 
to claim 1 or a method according to claim 21 comprising 
a plurality of pieces of recording medium, each piece of 
recording medium having thereon at least one respective 
cluster of discrete features with each feature defining 
a different position in the cluster, arid with the 
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features in each cluster defining at least first and 
second cluster relationships, each cluster relationship 
based on at least one of the colour, shape, size, 
position and connectedness of the features, in the 
■' cluster. • • iv' '•■■>-' ; ; ' 

63. Apparatus* for controlling a printer to print a 
calibration pattern, comprising: 

means storing data defining a pattern comprising a 
plurality of discrete features with each feature defining 
a respective position in the calibration pattern, at 
least some of the features being grouped into clusters 
such that the features in: a* given cluster satisfy at 
least first and second cluster relationships/ each 
cluster relationship based on at least one of the colour, 
shape, size, position and connectness of the features in 
the cluster; and ^ / 

signal generating means for generating a signal to 
control a printer to print the pattern on at least one 
recording medium* 

64. Apparatus according to claim 63, wherein the signal 
generating means is arranged to generate the signal to 
control a printer to print the pattern with a size in 
dependence upon a received size measurement. 
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65. Apparatus according to claim 63 or claim 64 > wherein 
the. signal generating means is arranged to generate the 
signal to control the printer to print different parts of 
the pattern on different recording media to generate a 

5 plurality of pattern parts • 

66. Apparatus according to claim 65, wherein the signal 
generating means is arranged to generate the signal to 
control the printer to print each pattern part so that 

10 the. f eatures in any given cluster are printed on the same 

recording medium- ■•/>.-* 

67. . Apparatus according to any of claims 63 to 66 when 
' embodied as part of the. printer. 

15 - . . * • . " .f \ \ ■'. . 

68. Apparatus for generating a photographic mat, 
comprising: 

means storing data defining a photographic mat 
having a pattern comprising a plurality of discrete 

20 features with each feature defining a respective position 

in the calibration pattern, at least some of the features 
being grouped into clusters such that the features in a 
given cluster satisfy at least first and second cluster 
relationships, each cluster relationship based on at 

25 least one of the colour, shape, size, position and 
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connectness of the features in the cluster; and 

means for generating; a signal to control a display 
device to display the pattern. 

69. / A method of controlling a -printer to print a 
calibration object, comprising: . 

storing -data defining a pattern comprising a 
plurality of discrete features with each feature defining 
a respective position on the calibration object,, at least 
spme of the features being .grouped into clusters such 
that the features in a given cluster satisfy at least 
first and second cluster relationships, each cluster 
relationship based on at least one of. the colour, shape, 
size, position and connectness of the features in the 
. cluster; and . . , : 

generating a signal to control a printer to print 
the pattern on at least . one recording medium. • 

70. A method according to claim 69, wherein the signal 
.is generated to control a printer to print the pattern 

with a size in dependence upon a received size 
measurement. 

71. A method according to claim 69 or claim 70, wherein 
the signal is generated to control the printer to print 
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different: parts of the pattern on different sheets to 
generate a plurality of pattern parts on., respective 
sheets. 

72. A method according to claim 71 , wherein the signal 
is generated to control the printer to print at least one 
cluster of features on each recording medium. 

73 . A method according to any of claims 69 to 72 wherein 
the method is performed in the printer 

*: .74-; • a method - of • generating * a photographic'-* ; niat , 
comprising: : ; v. ^ y . •; * v- » 

' storing data defining a photographic mat having a 
pattern comprising a plurality of discrete features: with 

each feature defining a respective position on the 

i .... 

calibration object, at least some of the features being 
grouped into clusters such that the features in a given 
cluster satisfy at least first arid secpnd cluster 
relationships, each cluster relationship based on at 
least one of the colour, shape, size, position and 
connectness of the features in the cluster; and. 

generating a signal to control a display device to 
display the pattern. 
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75. A method of processing image data defining* an image 
of at least part of a subject object and a calibration 
object, the calibration object having a plurality of 
features arranged in patterns such that the features in 
a pattern share at least two properties, to calculate the 
position and orientation of the image, comprising:* 

processing the image data to detect patterns 
comprising features having the first property; 

determining which of the detected patterns comprise 
features which also have the second property; 

determining a plurality of one-to-one 
correspondences between points in the image and points on 
.the calibration object using the patterns in the image 
determined to comprise features having both the first and 
second properties; and 

determining the position and orientation of the 
image using at least some of the determined one-to-one 
correspondences* 

76. A calibration object having a plurality of features 
arranged in patterns such that the features in a pattern 
have at least two detectable properties. 

77. A method of generating data defining a calibration 
object, comprising:: . - 
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generating pixel data defining a pattern comprising 
a plurality of discrete features with each feature having 
a respective position and at least some of the features 
being grouped into clusters such that the features in a 
5 cluster satisfy at least first and second cluster , 

relationships, each cluster relationship :based on at 
least one of the colour, shape, size, position and 
connectivity of the features in the cluster; and 

storing the pixel data on a storage device. , 
10 • 

78. A method of generating data defining a calibration 
pattern, comprising ' " 

generating pixel data defining a plurality of 
images,' each image comprising a plurality of discrete 
15 features with each feature having a respective position 

- and the features grouped into clusters such that the 
1 features in a cluster satisfy at least first and second 
cluster relationships, each cluster relationship based on 
at least one of the colour, shape, size, position and 
20 connectivity of the features in the cluster; and 

storing the pixel data on a storage device. 



25 



79. A method of generating data defining a calibration 
object, comprising: 

generating pixel data defining a pattern comprising 
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a plurality; of discrete features with each feature having 
a respective position and at least some of the features 
being grouped into clusters such that the features in a 
cluster satisfy at least first and second cluster 
relationships ,. each cluster relationship based on at 
least one of ,, the colour, shape, size, position and, 
connectivity of- the features in the . cluster and 

generating a. signal conveying the pixel data. 

.80. A method of generating data defining a calibration 
pattern, comprising 

..generating pixel- data , defining a plurality of 
images , each ; image comprising a plurality of discrete 
features with each feature having a respective position-: 
and the features grouped into clusters such that the 
features in a cluster satisfy at least first and second 
cluster relationships, each cluster relationship based on 
at least one of the colour, shape, size, position and 
connectivity of the features in, the cluster; and • 
generating a signal conveying the pixel data* 

81. A storage device storing data . defining a pattern 
comprising a plurality of discrete features with each 
feature having a respective position and at least some of 
the features being grouped into clusters such that the 
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features in a cluster satisfy at least first and second 
cluster relationships, each cluster relationship based on 
at least one of the colour, shape, size/ position and 
connectivity of the features in the cluster. 

82. A storage device according to claim 8i, wherein the 
data stored thereon comprises pixel data for printing, 
and the pixel data defines a plurality of " respective 
images for printing containing different respective 
clusters of the pattern. 

83. A signal conveying data defining a pattern 
comprising a plurality of discrete features with each 
feature! having a respective position and at least some of 
the features being grouped into clusters such that the 
features in a cluster satisfy at least first and second 
cluster relationships, each cluster relationship based on 
at least one of the colour, shape, size, position and 
connectivity of the features in the cluster. 

84. A signal according to claim 83, wherein the data 
comprises pixel data for printing, and the pixel data 
defines a plurality of respective images for printing 
containing different respective clusters of the features. 
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.85. A storage device storing instructions for causing a 
programmable processing apparatus to become operable to 
perform a method as set out in at least one of claims 2 2 
to 46 , 69 to 75 and 77 to 80. 

8 6. A signal conveying instructions for causing a 
programmable processing apparatus to become operable to 
perform a method as set out in at least one of claims 22 
to 46, 69 to 75 and 77 to 80. 

87. A method according to any one of claims 22 to 46 , 
- further comprising the step of generating data for 

.controlling, an apparatus to, create a « physical model of 
the subject object. , 

88. A method according to any of claims 22 to 46 and 87, 
further comprising the step of generating a physical 
model of the subject object. 

89. A method of generating a calibration pattern 
comprising a plurality of discrete features, the method 
comprising providing features so that each feature has a 
different respective position in the pattern and so that 
at least some of the features are grouped into clusters 
such that the features in a cluster satisfy at least 
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first and second cluster relationships , each /cluster 
relationship based on at least. one of the colour, shape, 
size, position and connectivity of the features in the 
cluster* 
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